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Motivated by a risk process with positive and negative premium 
rates, we consider a real- valued Markov additive process with finitely 

f\^ ' many background states. This additive process linearly increases or 

decreases while the background state is unchanged, and may have up- 
ward jumps at the transition instants of the background state. It is 

i -^ | known that the hitting probabilities of this additive process at lower 

d ■ levels have a matrix exponential form. We here study the hitting 

probabilities at upper levels, which do not have a matrix exponen- 
tial form in general. These probabilities give the ruin probabilities in 
the terminology of the risk process. Our major interests are in their 
analytic expressions and their asymptotic behavior when the hitting 
?^ , level goes to infinity under light tail conditions on the jump sizes. To 

derive those results, we use a certain duality on the hitting proba- 
bilities, which may have an independent interest because it does not 
need any Markovian assumption. 



O 

f— ^ , 1. Introduction. Consider a risk process in which premium rates, claim 

""^ | arrivals and claim sizes depend on a background state, which is governed by 

a continuous time Markov chain. The premium rate is usually assumed to 
be positive, and can be reduced to unit by a random time change. Suppose 
that the premium includes returns from investments. Then, it may happen 
that the premium rate takes negative values since the returns may be nega- 
k> | tive. This motivates us to consider a risk process with positive and negative 

!-h ' premium rates. Our primary interest is in an asymptotic behavior of the 

ruin probability when the initial reserve goes to infinity, provided the claim 
size distributions have light tails, that is, decrease exponentially fast. 
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2 M. MIYAZAWA 

Similarly to Asmussen (2000), we model the risk process as a Markov 
additive process Y(t) with upward jumps and Y(0) = 0. Then, for x > 0, 
x — Y(t) is a risk process with initial reserve x, and ruin occurs when Y(t) 
hits level x. We assume the following setting. The background continuous- 
time Markov chain has a finite state space. The additive component linearly 
increases or decreases while the background state is unchanged. At the tran- 
sition instants of the background Markov chain, the additive component may 
have upward jumps whose sizes may depend on the background states be- 
fore and after the transitions. This additive process was recently studied by 
Takada (2001) and Miyazawa and Takada (2002) for extending the Markov 
modulated fluid queue [see, e.g., Asmussen (1995) and Rogers (1994)]. 

A key observation in Miyazawa and Takada (2002) and Takada (2001) 
is that the hitting probabilities in the downward direction have a matrix 
exponential form, which follows from the fact that the additive process is skip 
free in this direction. The result generalizes the matrix exponential forms in 
the literature [see, e.g., Asmussen (1995, 1995), Rogers (1994) and Takine 
(2001)]. However, we can not directly apply this result to the ruin probability 
since this requires the hitting probabilities in the upward direction. 

In this paper we consider these hitting probabilities. We represent the 
hitting probabilities as a Markov renewal function. Then, their asymptotic 
behaviors are studied through the Markov renewal theorem. This renewal 
approach for the asymptotic behavior is rather classical, but has not been so 
popular for the Markov additive process. A typical approach is the change 
of measures based on martingales [see, e.g., Asmussen (2000)]. The large 
deviation technique has also been used. The latter can be applied for a 
larger class of additive processes, but is less informative. In this paper we 
show that the Markov renewal approach is yet powerful, in particular, it 
provides the prefactor of the decay function. 

To fully utilize this approach, we need to get the Markov renewal kernel 
in a closed form, which is the conditional joint distribution of the ladder 
height and associated background state given an initial background state. 
To this end, we use a dual additive process similarly to Asmussen (1991) 
and Sengupta (1989). This dual process is obtained from the Markov ad- 
ditive process by time reversal and changing the sign of the additive com- 
ponent. However, our approach is different from those in Asmussen (1991) 
and Sengupta (1989), which use the occupation measure. We directly de- 
rive the joint distribution, including the ladder epoch, in terms of the dual 
process, which does not require any drift condition on the additive process. 
Furthermore, we do not need any Markovian assumption, but only need sta- 
tionarity. This result may be of independent interests, so we derive it under 
the stationary regime. We then specialize it to the Markov additive process 
and perform detailed computations. 
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This paper is made up by six sections. In Section 2 we introduce the 
additive process with upward jumps under the stationary regime, and com- 
pute the ascending ladder height distribution in terms of the dual process. 
In Section 3 we specialize this result to the Markov additive processes. In 
Section 4 we derive a Markov renewal equation for the hitting probabilities. 
In Section 5 those probabilities are shown to have asymptotically exponen- 
tial decay. In Section 6 we discuss applications to risk processes and fluid 
queues. 

2. The additive process under the stationary framework. In this section 
we introduce a stationary additive process and consider its ascending ladder 
height, not using any Markovian assumption. Let {(t n ,M n ,A n );n € Z} be 
a stationary marked point process, such that the counting measure N of 
{t n } has a finite intensity A and the mark (M n , A n ) takes values in S x R + , 
where S is a countable set, Z is the set of all integers and R+ = [0, oo). In 
our application S is finite, but this does not matter in this section. In the 
terminology of a risk process, t n is the arrival time of a claim if A n is positive 
and M n is a background state. Note that not all t n represent claim arrivals 
since A n = is allowed. This gives a great flexibility when we assume M n to 
be Markov. Namely, the claim arrivals are subject to the Markovian arrival 
process due to Neuts (1989) [see Asmussen (2000) for applications to a risk 
process] . 

Let M(t) and A(t) be continuous-time processes such that M(t) = M n and 
A(t) = A n , respectively, for t £ [t n , t n+ i). As usual, we can choose a canonical 
probability space (Cl,J-,P) with a shift operator group {6t} on such that 
P{{6 t {oj) 6 D}) = P{D) for all Def, and, for w G fi, s € R = (-oo, +oo), 

N{B){9 s (uj)) = N(B + s){oj), B€B(R), 

M{t)(0,(u)) = M(t + 8)(u), A(t)(d a (u))=A(t + s)(u), teR, 

where B + s = {u + s;u € B}. We shall use abbreviated notation such as 
M(t)o6 s for Af(t)(0,(w)). 

We next define an additive process. Let v(i) be a function from S to 
R\ {0}. For simplicity, we exclude the case v(i) = 0, but this is not essential. 
Then, Y(t) is defined as 

t+ rt+ 

v(M(u))du+ / A(u)N(du), t > 0, 

v(M(u))du- / A(u)N(du), t < 0. 
t- Jt- 

Thus Y(t) is the additive process that linearly changes while M(t) is con- 
stant and may have jumps when it changes. Note that Y(t), M{t) and A(t) 
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are right continuous and Y(0) = 0. By definition, Y(t) has stationary incre- 
ments and satisfies (Y(t) — Y(s)) o 9 U = Y(t + u) — Y(s + u). In particular, 
F(0) = implies 

(2.2) r(t) o U = y(t + «) - Y(u). 

We refer to l"(i) as a stationary additive process with background process 
M(t). 

Let t£ be the hitting time when Y(t) gets into [x, oo) for x > 0. Namely, 

r+=inf{t>0;y(t)>a;}. 

Then, ^(tq ) is called the ascending ladder height, which is zero when Y(t) 
continuously crosses the origin. Note that Tq~ and, hence, Y(tq) and M(tq) 
are defective (proper) if 

E(Y(l)) < (>)0 respectively. 

As is well known, this can be proved using Loynes' (1962) arguments. If 
M(t) is a Markov process, E(Y(1)) > implies that Tq is proper [see Lemma 
2.1 of Miyazawa and Takada (2002)]. In what follows, for i G S, the event 
{M(tq) = i} means the event {tq < oo, M(tq) = i}. 

The purpose of this section is to express the joint distribution at the 
ascending ladder epoch, that is, for i,j € S,u,x,z> 0, 

P(t+ < u;M(0)=i,M(r+-)=j,M(r+) = k, -Y(r+) < z,Y(r+) < x), 

in terms of dual processes M(t), A{t) and Y(t) defined below. In our ap- 
plications we only need the case that u = z = oo, but the joint distribution 
may be of independent interests, as we shall see. 
Define dual processes M(t) and Y(t) by 

M(t) = M(-t), A{t) = A{-t), Y(t) = -Y(-t) + Y{0-), t € M. 

Note that Y(t) is also a stationary additive process with upward jumps sat- 
isfying y(0+) = 0. The term Y(0—) is irrelevant in the definition of Y(t) 
under the stationary setting, that is, with respect to P, since P(Y(0) = 
Y(0— ) = 0) = 1. However, this is not the case under the conditional prob- 
ability measure, given that there is a point of iV at the origin. Note that 
the dual process Y(t) is not right continuous but left continuous. Thus, 
Y(0) = Y(0-) may be negative. Similarly to Y(t), M(t) and A(t) are left 
continuous. Furthermore, if M(t) =i, then Y{t) changes at rate v(i), that 
is, Y(t) and Y(t) have the same rate when their corresponding background 
states are identical. Let 

f~ = mi{t>0;Y(t)<w}, w<0. 

That is, f~ is the hitting time of Y(t) at level w < 0. Note that Y(t) is skip 
free in the downward direction. So the distributions of f~ and M(f~) are 
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easier to get when the background process M(t) is Markov. This fact will 
be used. 

Since A = E(N(0, 1]) < oo, we can define the Palm distribution with re- 
spect to the point process N, which is denoted by Pjy. Let 

a~(t)=snp{u<t;N([u,t)) > 0}, 
a + (t) = inf{u > t; N([t, u)) > 0}. 

We also use their duals: cr _ (t) and <r + (£), by changing N to its dual N, 
where N(B) = N(-B) for B G B(R) in which -B = {x £ R; -x£B}. For 
example, cr~ (t) is the last transition instant of M before time t. Note that 
the dual processes under P coincide with the original processes under P, 
which is a canonical probability measure for (N (•) , M (t) , A(t)) . For example, 
E^(if(fZ x )) = Eft(ip(Tl x )). Keeping these facts in mind, we present the 
following results, using the following notation: 

S~ = {i G S; v(i) < 0}, S + = {i G S; v(i) > 0}, 

M-(t) = (M(a-(t)-),M(t)), M+(i) = (M(t),M(a + (t)+)). 
Note that M~(t) = (M(t-), M{t)) if N({t}) = 1. 

Lemma 2.1. For a nonnegative measurable (p, i G S" - , j,k £. S and x,z> 
0, 

-t;(z)F(^(r + );M(0) = i,M-(r +) = (j,fc), 

(23) -^(r + -)<z,0<y(r + )< a ;) 

= A f E N (ip(fZj; M+(0) = (fc, j), M(rr tt ) = i, 
Jo 

< A(0) -w <x)dw, 
and, using the notation T = Y(0) — Y(a~(0)+), for i G S~ , k G 5 + , 
- W (i)F(^(r + );M(0) = i,M-(r + ) = (i,A ; ),y(r + ) = 0) 

(2-4) =A/ E N (ip(f: w );M + (0) = (k,j),M(f:J = i, 

Jo 

A(0)<w<f + y)dw, 
where E(X;D) = E(X1d) for a random variable X and an event D. 

Proof. We first consider the case that Y(tq) > 0. In this case the 
additive process Y(t) only up crosses level by a jump. Hence, we have 

E(<p(t£);M(0) =i,M~(r+) = (j,k),-Y(r+) <z,0< Y(r+) < x) 
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= e( r<p(t)l(M(0)=i,M-(t) = (j,k), 

(2.5) Uo 

Y(u)<0,ue(0,t), 

- Y(t-) < z, Y(t) G (0, x])N{dt) 

where l(-) is the indicator function of the statement "•". To (2.5), we apply 
Campbell's formula [see, e.g., (3.3.1) of Baccelli and Bremaud (2002)], which 
is given for a random function g(t) by 

E (7°° g{t)o 9 t N(dt)\ = \E N (J°° g(t) dt\ . 

To this end, we apply 6L 4 to the events in the indicator function of (2.5). 
By (2.2), 

Y(t) o 0-t = -Y(-t) = Y(t) - f (0). 

Thus, using the fact that Y"(0+) = 0, we have 

(M(0) = i, M(t-) = j, M(t) = k} o 0-t 

= (M(0) = k, M(0+) = j, M(t) = i}, 

{Y(u)<0,uG(0,t)}oe- t 

= {Y(t)<Y(u),ue(0,t)}, 

{-Y(t-)<z,Y(t)e(0,x]}o6_ t 

= {~Y(t) < z, -y(0) -x< -Y(t) < -Y(0)}. 
Hence, applying Campbell's formula to the right-hand side of (2.5) yields 
E(<p{4); M(0) = i, M-(r +) = (j, k), < y(r + ) < x) 

= \E N (r^ )l(M + (0) = (fc,j),M(fr )=», 

(2.6) V ° 



y (t) < y (u), u e (o, t), -y (t) < z, 
-y(o) - x < -y(t) < -y(o)) dA . 



where the fact that t = f- when t is the descending ladder epoch is used. 

Y \t) 

We now change variable t in the integral in (2.6). Let 

w(t) = - inf Y(u). 

0<u<t 
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Clearly, w(t) is nondecreasing, and w(t) = —Y(t) when w(t) increases be- 
cause the dual process Y(t) is left continuous and skip free in the downward 
direction. So, we have 

w'(t) = -v(M(t))t(Y(t) < Y(u),u e (0, t)). 

Hence, changing variables from t to w = w(t) in (2.6) and using the fact that 
A(0) = —Y(0), we obtain (2.3). We next consider the case that k € S + and 
Y(tq ) = 0. Similarly to (2.5), we have 

E(<p(j+);M(0) =t,M-(r+) = (j,k),Y(r+) = 0) 

= e( H <p(t)t(M(0) = i,M~(t) = (j,k), 
(2-7) U ° 

Y(u)<0,ue(0,t), 

Y(t)<0<Y(a + (t)-))N(dt) 

Hence, we can apply similar arguments as for the case Y(tq) > 0, but we 
need to replace the event {0 < Y{t) < x} o 9-t by 

{Y(t)<0<Y(a + (t)-)}o6^ t 

= {-Y(-t)<0<Y(a+(0)-)-Y(-t)} 

= {A(0) < w < F(0) - y(er-(0)+) + 1(0)}, 

for w = -Y{t). Hence, (2.4) follows. □ 

Remark 2.1. (a) A key fact in Lemma 2.1 is that the ladder height 
distribution, given the initial state, can be obtained via the hitting times in 
the skip free direction. 

(b) Lemma 2.1 does not need any drift condition on Y(t). So, the dis- 
tribution in the left-hand side of (2.3), with (p = 1, may or may not be 
defective. 

(c) Consider the special case that N is Poisson and v(l) = — 1 with 
S = {1}. This constitutes the classical risk process. Then, (2.3) is compati- 
ble with standard results, such as Theorem 2.2 in Chapter III of Asmussen 
(2000), provided E{Y(l)) < 0. 

In the rest of this section we shall give further remarks and results on 
Lemma 2.1. We first note the interesting feature of (2.3), that the sample 
path of the forward process is traced back under the Palm distribution. 
Figure 1 illustrates this sample path behavior. This fact is also related to 
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the following conditional trace back for the conventional Markov modulated 
risk process, that is, in the Markovian setting with v = —1. 



(2.8 



P(r+ <t\M(0) = i,M-(r+) = (j,k),-Y(r+-) = z) 

= P(tZ z < t|M+(0) = (k,j),M(fI z ) = i), t,z>0. 



See, for example, (2.1) of Asmussen and Efojgaard (1996) and Proposition 
2.2 of Asmussen and Kliippelberg (1996) for the derivation of (2.8). Let us 
show how (2.8) is obtained in our approach. From (2.3), we have, for i € S~, 
j,k G S and t, z > 0, 



(2.9) 



-v{i)P{4 < t,M(0)=i,M-(r+) = (j,k),0< -Y(r+-) < z) 



A / P N {fI w <t,M+(0) = (k,j),M{fZ 
Jo 



i,w <A(0))dw. 



Hence, taking the derivative of (2.9) with respect to z and dividing by this 
derivative with t = oo, we get, for t > 0, 



(2.10) 



P(r+ < t\M(0) = i, M-(r +) = (j, k), -Y(t+-) = z) 

= P N {fZ z < t|M + (0) = (k,j),M(fI z ) =i,w< i(0)). 



In the Markovian setting, Pjy in (2.10) can be replaced by P, and f~ and 
M(fZ z ) do not depend on ^4(0) since Y(0+) = 0. So we arrive at (2.8). Note 
that (2.10) is less informative than (2.9), equivalently, (2.3). Namely, we 
need (2.9) with t = oo to get (2.9) from (2.10). 

We next sum (2.3) with <p(y) = l(y < t) over all i,j,k, which yields 

Corollary 2.1. If v(i) = -1 for ie S~ , we have, for t,x,z> 0, 
P(r + < t,-Y(r+-)< z,0 <Y(t+) < x) 




Base line of 



-* — Time reversed direction 

Fig. 1. The additive process Y(t) and its dual Y(t). 



no 



HITTING PROBABILITIES IN RISK PROCESS 
(2.11) 



A / P N {fZ w <t,0< 1(0) - w < x) dw, 
Jo 
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where v(i) can be an arbitrary positive number for i € S + . 

Remark 2.2. If S + = and E(Y(1)) < 0, then (2.11) with t = oo agrees 
with the well-known formula for the severity in a risk process [see, e.g., 
Asmussen (2000)], since P(fZ w < oo) = 1 and P N (A(0) <x) = P N (A(0) < 
x). On the other hand, if x = z = oo, it generalizes Proposition 2.3 in Chapter 
IV of Asmussen (2000), which is obtained for the case that N is Poisson. 

Lemma 2.1 also generalizes Proposition 3.1 and Theorem 3.1 of Asmussen 
(1991), which assumes that v(i) = —1. We here note another aspect of 
Lemma 2.1. 

Corollary 2.2. // there are no jumps, that is, Fij (0) = 1 for all i,j € S, 
then we have, for i S S~ and k S S + , 

(2.12) - v{i)P{M(0) = i, M(t+) = k) = v(k)P{M(0) = k, M(f ") = i). 

PROOF. Since Y(tq) = with probability one, (2.4) with tp = l yields 
-v(i)P(M(0) = i, M{o~(t+)-) = j, M{t+) = k) 

POO 

= \ / dw P N (M(0) = fc,M(0+) = j,M(fZ w ) =i,w <f). 
Jo 

Summing over all possible j and using the fact that T = —v(k)a~(0) and 
M(fZ w ) ° 8- w / v (k) = M(tq) on M(0) = k, we have 

-v(i)P(M(0) = i, M{t£) = k) 

POO 

= X dwP N (M(0) = k,M(fZ w )=i,w<f) 
Jo 

= XE N (J t[M(-w/v(k)) = k, M(tq) o 6 w/v(k) = i] dw^j . 

Since T = v(k)a + (0), we get (2.12) by the Palm inversion formula. D 

Equation (2.12) explains how upward hitting is interpreted in the dual 
additive process when there are no jumps. Suppose — oo < E(Y(1)) < 0. 
Then (2.12) also yields 

P(r+<oo) = ^, 

where a+ = EieS+ v(i)P(M(0) = i) and aT = - Y,ieS~ v(i)P(M(0) = »). 
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3. The Markov additive process. From now on we specialize M(t) to be 
a continuous-time Markov chain with finite state space S and assume that 
A(t) only depend on M(t-) and M(t). In this setting (M(t),Y(t)) is called 
a Markov additive process. In this section we derive the ascending ladder 
height distribution in a closed form for this additive process. 

Let Cij for i^j and D^ for all i,j G S be nonnegative numbers and let 






For convenience, let c(i) = —Ca. Let C = {Cij} and D = {Dij} be S x S 
matrices. We take C + D for the rate matrix of Markov chain M{i) and 
assume that C + D is irreducible. Since S is finite, this implies that the 
Markov chain has a unique stationary distribution, which is represented as 
a row vector tv = {vtj}. 

Note that the Markov chain M(t) may include transitions that do not 
change their states, since Da may be positive. Of course, these transitions 
are irrelevant for the sample path of M(t), but they are convenient to include 
Markov modulated Poisson arrivals for the jumps in our formulation. So we 
let N be the point process generated by all the transition instants. Let Fjj 
be the jump size distribution associated with transitions due to Dy, where 
Fjj(0) = 0, while no jumps are associated with transitions due to Cij. Then, 
the conditional distribution Fy of A(t), given that M(t—) = i and M(t) = j, 
is obtained as 



*£(*), 



i=j, 



for x > 0, where 5(x) is the Dirac distribution which has a unit mass at the 
origin. In this way the additive process Y{t) is completely specified for the 
rate function v. 

Define Cij{x) and Dij(x) as 

C^ (x) = Cij5(x) , D^ (x) = DijFfj (x), i,j G S. 

We denote the matrices which have these entries by C(x) and D(x), respec- 
tively. For convenience, we also define matrix U(x) whose ij-entry is defined 

as 

(3.1) U ij (x) = ±(i^j)C ij (x)+D ij (x), i,jeS,x>0. 

Clearly, the additive process Y(t) is specified by C, D(x) and the rate func- 
tion v. 
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We now evaluate (2.3) and (2.4) in the Markov setting. To this end, we 
first consider the dual Markov chain M(t) for M(t) and the dual additive 
process Y(t), defined in Section 2. Define S X S matrices: 

C{x) = A^C(x)'^ D(x) = A 7r 1 D(x)'A 7r , 

U(x)=A n 1 U(x)'A 7r , 

where A.^ is the diagonal matrix whose ith entry is ir(i) and ""' stands for 
transpose. Obviously, we see that M(t) has transition rate matrix C + D, 
where C = C(oo) and D = D(oo). Y(t) and Y(t) have the same rate function 
v for the continuous movements. Thus, Y(t) is the Markov additive process, 
specified by C(x), D(x) and v. 

We next modify Lemma 2.1 in a convenient form for the Markov additive 
process. Let Fjk = Fkj- Then, from (2.3) and (2.4), we have, for i G S~ , 
j,k G S and x > 0, 

-v(i)E(M(0) = i, M-(r +) = (j, k), < Y(r+) < x) 

\o.Z) 



= \J dwj^ F k] (dy)P N (M + (0) = (k,j),M(fZ {y _ w) )=i), 

and, for i G S~ , k G 5 + , 

-v(*)£(M(0) =*,M-(t + ) = (j,A:),y(T + ) = 0) 

/*oo /'oo 

(3.3) =A/ d«; / F fci (dy)P i v(M + (0) = (A : ,j),M(fr uj ) = i, 

jo Jo 

y <w <f + y). 

Lemma 3.1. For ie S~ , j,k<E S and x>0, 
P(M-(r +) = (j, fc),0 < Y(r+) < x\M(0) = i) 

= ^L dW L D kj (dy)P N (M(f: (y _ w) ) = iM(0+)=j)^ r) 

and, for i G S~ , j £ S and k G S' + , 

P(M"(r+) = (J, k),Y(r+) = 0|M(0) = t) 

(3.5) =^/ e-^W^du,/ ^(dy) 

VTj Jo JO 

x Piv(M(fI f?/ ,,„0 =i|M(0+) = j)~ 



Proof. We only need to evaluate the Palm probabilities in (3.2) and (3.3). 
Since M(t) is the Markov chain with rate matrix C + D, it is easy to see 
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that 

XP N (M(0) = fc,M(0+) =j,M(fZ {y _ w) )=i) 

= P N (M(fZ [y _ w) ) = i\M(0+) =j)(t(k^j)C kj +D kj )ir k . 

Hence, (3.2) and (3.1) yields (3.4). Since T of Lemma 2.1 is exponentially- 
distributed with mean —c(k)/v(k), the right-hand side of (3.3) becomes 

/•OO /"OO 

A/ F kj (dy) dwP N (M + (0) = (k,j),M(fZ w )=i,y<w<y + f) 
Jo Jo 

= ^ru k3 {dy)r e ~ c{k)uKk)z ^- du 

Jo Jo v(k) 

rv+u 
x / dwP N (M(fZ w )=i\M(0+)=j) 

=n k ru kj (dy) r dw r e -^^^d U 

Jo Jy Jw-y V[k) 

xP N (M(fZ w )=i\M(0+)=j) 

= * k U kj (dy) e -<k){ W -y)/v{k) dw 
Jo Jy 

xP N (M(fI w )=i\M(0+)=j). 
Hence, (3.3) yields (3.5). □ 

In (3.4) and (3.5), it remains to evaluate 
(3.7) R^(x) = P(M(fZ x )=j\M(0) = i), x>0,ieS,jeS-. 

By R (x) and i? H (x), we denote the S~ x S~ and 5 + x 5~ matrices whose 
ij entry is given by (3.7), respectively. We shall use this convention widely. 
Namely, for S x S matrix A, its submatrices of sizes S~ x S~ , S~ x S + , 5 + x 
S~ and /S" 1 " x S + are denoted by A , A '", A^ and A ++ , respectively. 
Similarly, for an 

S-vector x, x~ and x + are the subvectors whose entries are indexed by 
S~ and S + , respectively. Note that R (x) is substochastic, that is, a non- 
negative matrix satisfying R (x)e~ < e~, where e is the column vector 
whose entries are all 1. 

We now refer to recent results on the matrix exponential form in the 
Markov additive process in Miyazawa and Takada (2002) and Takada (2001). 
The results there are obtained for the forward process {(Y \t) , M (£))} that 
is right-continuous. On the other hand, we here need the corresponding re- 
sults for the dual process {(Y (£) , M (£))} that is left-continuous. However, 
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this left-continuity is irrelevant in the definition (3.7), since Y(t) is skip free 
in the downward direction. 

This skip free property also implies that the ladder height indexed pro- 
cess {M(fZ x );x > 0} is Markov. Hence, R (x) = e x ® for some subrate 
matrix , that is, Q e_ < 0~. It is also easy to see, at least intuitively, 
that 

-=(U!)-^r«^^)(U::!)- 

Then, the following results would be intuitively reasonable. Their formal 
proofs not for Y(t), but for the forward process Y(t) are given in Theorem 3.2 
of Miyazawa and Takada (2002) and Theorem 4.1 of Takada (2001). Clearly, 
the results are immediately transferred from Y(t) to Y(t). In what follows, 
a square matrix is said to be ML if its off-diagonal entries are nonnegative. 

Lemma 3.2. There exist a subrate matrix Q^~> and a substochastic ma- 
trix W , such that 

^> (f-SHF-K'- ^ 

where Q and R^ are the minimal ML and nonnegative solutions, re- 
spectively, of the following equation: 

(3.9) - (|7_) Q(-> = A; 1 jH(C(du) + D(du)) ( jp) e<&~\ 

Furthermore, Q^' is a rate matrix, if and only if 

/•CO 

(3.10) E (Y (I)) (=E(Y {!)))= TV A v e + n / xD(dx)e < 0. 

Jo 

We next represent Q^> and IV using the original additive process. Let 
K^> and L h be the minimal solutions of the following equation, such that 
K^~> and L h are ML and nonnegative matrices, respectively: 

/*oo , -. 

(3.11) -K(-\l—,lr + )= e uK( ~\L—,L- + )(C{du) + D{du))&- 1 . 

Jo 

Then Q' ' and W are obtained as 

(3.12) gH = (A--)-\K^)'A--, fl+- = (A++)- 1 (L-+)'A;-. 

Corollary 3.1. // (3.10) is satisfied, then 

(3.13) ir~K^=0, 7r-L- + = 7r + , 

and K(> has the right eigenvector k~ corresponding to 7r~ . Normalize k~ 
in such a way that 7r~k~ = 1. Then, k~ is unique and positive and k~7r — 
K^> is nonsingular. 
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Proof. Since Q^e~ = 0~ and fl+~e - = e+ by (3.10), (3.12) impl- 
ies (3.13). (k _ )'A~~ is the stationary distribution of Q ) since (k _ )'A 7r ~e = 
7r k~ = 1. Hence, k _ is unique and positive. Assume that 

(3.14) (k"7r"-K ( - ) )x = 0, 

for an S~ -dimensional vector x. Pre-multiplying K^' to (3.14), we get 
K^~\K^>~x) =0. Hence, K^'x. must be ak~ for some constant a. Since 
tt~K(~> = and 7r~k~ = 1, we arrive at a = 0, which concludes x = 0. So 
the matrix k~7r _ — K^> is nonsingular. □ 

We remark that similar eigenvectors have been reported for the case that 
S + = in Section 2 of Chapter VI in Asmussen (2000). Let us compute 
the ascending ladder height distribution. For this computation we need one 
more lemma. 

Lemma 3.3. Let A c be the diagonal matrix whose jth diagonal entry is 
c(j) = —Cjj, then, for j € S + and i £ S~ , 



(3.15) / e wc{j)/ ^ j) dw 
Jo 



00 ~ ( I~ 
U{dy)[ k , 



D (y+w)Q(- 



Ji 



[A++5+-V 



Proof. By (3.9), the left-hand side of (3.15) is 



^c(j)/v(j) dw 



C °(C(dy)+D(dy)-5(dy)(-A c )) ( |~ 



D (y +W )Q(-) 



roo 

- / e wc(j)/vU) dw 
Jo 



A v 



R- 



)(-) 



+ (-A c ) 



r 



j i 



3 iuQ(-) 



J' 

D 



Theorem 3.1. For i € S~ , j € S and x>0, 
P(M(t+) =j,Y(r+) < x\M(0) = i) 



(3.16) 



1 



-v(i) \Jo 



dw 



,(y-w)K(-) 



(r-,L~ + )D{dy) 



+ t(jeS + )LT j + v(J))- 



PROOF. Let J tj (x) = P(M(t£) = j, Y(r£) < x\M(0) = i). We first con- 
sider the case that Y(tq) = 0. From (3.5) and Lemma 3.3, we have 



J lJ (0) = ^l v ( j )R+ 

1T± J 



vn 
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Using ttjR^ = 7TjL~ + , this yields (3.16) for x = 0. We next consider the 
case that Y(tq) > 0. From Lemmas 3.1 and 3.2, we have 



Jij (x) - J tj (0) = ^£dw jT° D{dy) ( |+- ) e 



,(y-w)&-) 



J i 



v(i)' 



Thus, we get (3.16) by converting to the notation of the forward processes. 

□ 

4. The hitting probability. We now consider the hitting probability at 
an upper level x > 0. Since (X(t),Y(t)) is a Markov additive process with a 
real additive component, we can obtain the hitting probabilities as a Markov 
renewal function using the appropriate ladder height distribution as a semi- 
Markov kernel. However, we can not use (3.16) of Theorem 3.1 as this kernel 
because the additive component may increase continuously. To have an ap- 
propriate kernel, we consider the ladder height at <7 + (Tg~), that is, the first 
transition instant of M(t) after crossing level 0. For convenience, define a 
random variable £+ for x>0as 

£ = °- + (r+). 

Clearly, £+ is a stopping time with respect to the additive process {(Y(t), M (£))}. 
Define S x S matrices H(x) and G{x) by 

Hij(x) = P(M($+) =j,Y($) < x\M(0) = i), 

Gij(x) = P(M(r+) =j,Y(£+) > x\M(0) = i), i,j eS,x>0. 

Define the hitting probability matrix \F(x) by 

* y (x)=P(M(r+)=j|M(0)=0. 

Then, ^(x) is obtained as the unique solution of the Markov renewal equa- 
tion, 

(4.1) y{x)=G(x) + H*^(x), x>0, 

where the convolution A * B{x) is defined for a matrix nondecreasing func- 
tion A{x) and a matrix function B(x) as 



[A * B(x)]ij = V / A ik {dy)B kj {x - y). 
u Jo 



k Jo 



The Markov renewal equation (4.1) will be the key for our arguments to 
obtain an asymptotic behavior of the hitting probability. Thus, what we all 
need is to get H(x) and G{x). We first consider the case that Y(tq) = 0. 
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Lemma 4.1. For i e S~ , j e 5 and x > 0, 

P(M(a+(r + )) =j,F(r +) = 0,y(a+(r +)) <x|M(0) = i) 

Proof. We need the following version of (3.3), for i € S~, j,l G S and 

keS + : 

-v(i)P(M(p) = i,M-(r£) = (l,k),M(a+(r+)) =j, 

(4.3) Y(t+) = 0,1> + (t+))<z) 

/■OO /'oo 

= A / dw / F jk (dy)P N (M(a-(0)) =j, 
Jo Jo 

M+(0) = (k,l),M(fZ w ) = i, 

y <w <T + y,T + T' + y <x + w), 

where T' = — Y(a~(0)) + Y(a~(0)+). Since this can be proved in exactly 
the same way as (3.3), we omit its proof. Thus, the right-hand side of (4.3) 
divided by —v(i) becomes 

\ poo poo poo n (h\ roo 

1 dw F jk (dz) 2W e -c(k)u/m du p kl (dy) 



v(i) Jo Jo Jo v(k) Jo 

x P N (M(a-(0)) = j,M+(0) = (k,l),M(fZj = i, 

y<w<u + y,u + y + z<x + w) 

(changing variable w to w — y) 

\ poo POO POO „( U\ POO 

= ~ dw F kl (dy) Em e -c(k)uMk) du p {dz) 
v(i) Jo Jo Jo v(k) Jo 

x P N (M(a~(0)) = j,M+(0) = (k,l),M(fZ {y+w) ) = i, 

<w <u,u + z <x + w) 

\ poo poo __ rx+W r(h\ ,. , , px+w—u 



dw F kl (dy) W e -c(fc)«Mfc) du / p jk (dz) 



v(i) Jo Jo Jw v(k) Jo 

x P N (M(a-(0)) = j,M+(0) = (k,l),M(fZ (y+w) )=i), 

where we have used the following fact. Conditionally, given that (&~(0)) = j, 
M(0) = k, M(0+) = I, M{fZ w ) = i, 

-Y(0)~F kh 

f = -y(or-(0)+) + Y(0) ~ Exp(c(k)/v(k)), 

f = -y(a-(0)) + Y(a-{0)+) ~ F ifc) 
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where ~ stands for equality in distribution and Exp(a) denotes the expo- 
nential distribution with mean 1/a. Hence, using a decomposition similarly 
to (3.6) and Lemma 3.2, the left-hand side of (4.2) is computed as 



TT 



oo / poo px+w px+w—u 



-*- I I / dw I du 

VTj JO \J0 Jw JO 



(t(j^k)C jk + D jk )F jk {dz) 



x « k *W» + D » FM) 



c{k) 



R+- 



^(fc) U 

D (y +W )Q(-) 



-c(k)u/v(k) 



-1 

uv(i) 



TT 



OO / POO 



e -c(k)w/v(k) dw / du 
TTj Jo \Jo JO 



x / U jk (dz) 



v(k) 



-c(k)u/v(k) 



C(k) 



Uu{dy) 



R J 



,(y+w)Q(-) 



liV(l) 



TT 



OO / POO 



e -c(k)w/v(k) dw / fj ■ , d ^ 
VTj Jo \J0 JO 



x (1 _ e -c(k)(x- Z )/v(k)^ _lfj kl{dy) 



R + - 



,(y+w)Q^ 



-1 

uv(i)' 



Summing this over all I € S and k G 5 + and applying Lemma 3.3 yield (4.2). 
□ 

Theorem 4.1. For i,jES and x > 0, Hij(x) is given by 



Hij(x) 



1 



-v(i) Wo 



dw 



£y-V>)K<--) ( j— T- + 



(I—,L- + )D(dy) 



(4.4) 



+ Ej x ^(i-«- eC * )( "- y)M * ) )^«(^)) 



ieS" 



ffy(s) = / (1-e 
Jo 



-c(i)(a;-j/)/?;(i)' 



-r^Uijidy), ieS~ 

c(i) 
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Proof. We first consider the case that % G S . From Lemma 4.1, we get 
Hij(0) of (4.4). On the other hand, from Theorem 3.1, 

P(M{t+) =j,0< Y(t+) < x\M(0) = i) 



1 



-vn Jo 



dw 



,(y-w)K(- 



)fr- 



(I—,L- + )D(dy) 



Thus, we get (4.4) converting to the notation of the forward processes. For i G 
S + , (4.4) is immediate, since £q is the first transition instant after time in 
this case. 

□ 

For G, we can get the following expression similarly to Theorem 4.1, using 
the fact that the first hitting over level x is attained either continuously or 
by a jump. 



(4.5) 



Corollary 4.1. ForieS + ,jeS, 

G ij {x) = t{i = j)e- xc ^' v ^ 



+ 



c(i) 



-c(i)y/v(i) 



/0 V(l) 

and, for i G S~ ,j G S, 
-1 



oo 1 
x-y C{i) 



d V / Z77^ U ij( dw )i 



x>0, 



Gij[x) 



v\i) 



dw 



(4.6) 



+ Lr+v(j)e 

+ E L 7k 

fce5+ 



,( v -w)K<--'> 



x Cjj/v(j) 



(I—,L- + )D(dy) 



ij 



v{k) 
c{k) Jo 



Ukj(dw) 



x-y 



v(k)' 



-yc{k)/v(k) 



dy 



x>0. 



5. Asymptotic behavior of the hitting probability. In this section, we 
study the asymptotic behavior of the hitting probabilities as the hitting 
level goes to infinity. Throughout this section we assume a negative drift, 
that is, 



(5.1) 



E{Y{1)) = 7rA v e + tv / D(du)e < 0. 



Under this condition, Y(t) — ► — oo as time t — » oo. Hence, the hitting prob- 
ability P{t% < oo\M (0) = i) converges to zero as x — > oo. Assume that the 
jump size distributions have light tails. Then, it is expected that the hit- 
ting probability decays exponentially fast, which is known as the Cramer- 
Lundberg approximation for the conventional risk model. Furthermore, a 
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Brownian component may be added [see Schmidli (1995)]. Instead of a Brow- 
nian component, we here have signed continuous movements. 

The decay rates for the hitting probabilities have been extensively stud- 
ied by the change of measure technique based on martingales [see, e.g., 
Asmussen (2000) and Rolski, Schmidli, Schmidt and Teugels (1999)], but 
this approach has not yet fully covered the Markov modulated model even 
for the case that v(i) = — 1 [see Section VI of Asmussen (2000)]. Here we use 
the Markov renewal theorem as in Miyazawa (2002), which considers the 
case that v(i) = — 1. This approach also uses a change of measure, but it is 
more straightforward. 

Let us briefly introduce this Markov renewal approach, following Section 2 
of Miyazawa (2002). Let S x S matrix P(x) = {Pj,(x)} be a Markov renewal 
kernel that may be defective, that is, P(x)e < e. Denote the moment gener- 
ating function of P(x) by P{9) = Jq°° e 8x P(dx). Since P{9) is a nonnegative 
and substochastic matrix, it has a positive eigenvalue 7(6*), such that the 
absolute values of all other eigenvalues are less than 7(0) and the associated 
right and left eigenvectors are nonnegative [see, e.g., Seneta (1980)]. Denote 
these associated eigenvectors by v^ e > and h> e > , respectively. Suppose that an 
S x S matrix functions ${x) and B(x) for x > satisfies the Markov renewal 
equation, 

(5.2) <f>(x) = B(x) + P*®(x), x>0. 

Then, Theorem 2.6 of Chapter X in Asmussen (1987) [see Miyazawa (2002) 
for the present context] reads as 

Lemma 5.1. Suppose the following four conditions: (5. a) P(x) has a 
single irreducible recurrent class that can be reached from any state in S with 
probability one, and the return time to each state in the irreducible recurrent 
class has a nonarithmetic distribution, (5.b) there exists a positive a such 
that 7(a) = 1, (5.c) each entry of e ax B(x) is directly Riemann integrable, 
(5.d) v( a > P( 1 )(a)h ( - a ) is finite. Then, we have 

(5.3) lim e ax <5>(x) = — — 5 _h( a M a M e au B(u)du, 

V ; *-°° V ; i»P (1) (a)h( Q ) Jo 

where P (1) {a) = ^P(9)\ e=a . 

Let us put P(x) = H(x), $(x) = *(x) and B(x) = G(x). Then, (5.2) holds 
by (4.1). Clearly, condition (5. a) is satisfied by the irreducibility of C + D 
and the exponential sojourn times of M(t). We next compute the moment 
generating function H(9) of H(x). From Theorem 4.1, the following results 
are obtained. 
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Lemma 5.2. 
(5.4) H{9) = 1- A~ l T{9){C + b{0) + 0A V ), 

where 

■{61- -K^y 1 {91- -K(-))- 1 L-+ + L-+A++(A++ ?v )- 1 



T{9) 



0+- -A++(A 



-i 



c-6vi 



Remark 5.1. Since T{9) is invertible as we will see, (5.4) can be written 

as 

(5.5) C + D{9) + 9A V = T{9)~ 1 A V {I - H{9)). 

This can be considered as a generator version of the Wiener-Hopf factoriza- 
tion [see, e.g., Arjas and Speed (1973)]. 

Since this lemma is just computations, we defer its proof to Appendix A. 
We notice that H{9) exists only for 9 < mm{c{i)/v{i);i € S + }. We shall use 
the following light tail assumption on D{x) and related regularity assump- 
tion: 

(i) D{9) is finite for some 9 > 0, 
(ii) sup{Z^-(0) < oo; i, j G S, 9 > 0} = co. 

Condition (ii) can be relaxed, but it is sufficient for most applications. 

Note that condition (5.1) implies that Q is a rate matrix. Since C + 
D{0) + 9A V is an ML matrix for each 9 > 0, it has a real eigenvalue k{9) such 
that it dominates the real parts of all other eigenvalues, and the associated 
left and right eigenvectors are positive. Denote these eigenvectors by n^> 
and h' ' , respectively. Let k~ be the right eigenvector of K^-' for eigenvalue 
0, where k~ is unique and positive (see Corollary 3.1). We normalize yy> 
and h.( e > so that 

(AiW)-k- = l, /AW = 1. 

Since k{9) = /xW(0A v + C + D{9))h^\ we have 

k'{9) = K {9){{^)'h^ + /iW(hW)') + /x( fl >(A v + D'(6))hW 

= ^ e HA v + b'{9))h^\ 

where we have used the fact that fi^'h^' = 1. This implies that k'(0) = 
E{Y{1)) < because /j,( ' = n. Hence, from the fact that k(0) = and k{9) 
is a convex function [see Kingman (1961)], condition (ii) guarantees that 
k{9) = has a unique positive solution. Thus, condition (5.b) is satisfied. 
Denote this solution by a. 



T(a) 
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To find u^ a ' for Lemma 5.1, we compute the inverse matrix of T(a): 

ocl- -K(-) L-+A++ av (A++)~ 1 + (a/~ - K^)L~ 
- 0+- -A++« V (A++)- 1 

Define v^ a > as 

(5.6) u {a) = - t i (a) T{e)- 1 A v . 

Clearly, u^ a > is the left invariant vector of H(a). We show that v^ a ' is 
positive. To this end, we introduce a twisted Markov transition kernel for 
H. Define 

H\x) = A- ( x a) f X e au H(d U )A h{a) , x > 0. 

«/ u 

Then, by our choice of h'"', i/^(oo)e = e, that is, H^(oo) is a stochastic 
kernel. From (5.4), we have 

*»A h(Q)J H-t(oo) = v^H(a)A h(a) 

= u& A h(a) + /x( Q ) (aA v + C + D(a)) = i>> A hM . 

Hence, i/ a )A h ( a ) is the left invariant vector of stochastic kernel .£F(oo). 
From (5.6) and the normalization of n^ a > , it follows that (v( a >)~(— A~~) _1 k _ 
a, and k~ is positive by Corollary 3.1. So, i/ a ) must be nonnegative and 
i/( a 'A h ( a ) is also nonnegative. Since W(oo) is a finite stochastic matrix and 
irreducible, which follows from the irreducibility of C + D, u^ a > A h ( a ) must 
be a positive vector and unique up to a multiplicative constant. Hence, f( a > 
is a positive vector. 

It is easy to see that h' Q ' is the right positive eigenvector of H (a) for the 
eigenvalue 1. Thus, we are now in a position to apply Lemma 5.1, for P = H 
and B = G. We first compute the following integrals. For i 6 S + , (4.5) yields 

oo 

e ax Gij(x)dx 
o 



(5.7) 



POO 

Sij / e ^ e -c(0/M0)s dx 

JO 

1 /* OO /"2? /* OO 

+ 4t/ e ax dx e- c{i)/{v{i))y dy UiAdu) 

V(l) Jo JO Jx-y 

-[A-l av (C + D(a) + aA v -(C + D))] i:j . 



Similarly, for i £ S , we have 



oo 

e ax Gij(x)dx 
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(al— - K^)~ l {I—,L- + ){C + D[a) + aA v ) 

+ (Q—,L- + )A v A-l av (C + D(a)+aA v -(C + D)) 

- k-ir-(J—,L-+) (A v + j™ yD(dyf) 

-(k-ir--«-H)-i(/— ,L-+)(C + £>) . 

- *j 
See Section A. 2 for the detailed derivation of this formula. Thus, condition 
(5.c) is satisfied. Then, applying Lemma 5.1, we have the following asymp- 
totics. 

Theorem 5.1. Suppose the stability condition (5.1) and the light tail 
conditions (i) and (ii). Then, the maximal eigenvalue n(0) ofC+D(9) + 9A v 
equals for a unique 9 = a > 0, and we have, for i,j € S, 



(5.9) 



lime ax P(M(T+)=j\M(0)=i) 
1 



n 



(a) 



h^fi^(r(a)--(C + D)\ 



where r]^ = ^ a \D (1) (a) + A v )h^ for the first derivative D {1) (a) of D(9) 
at 9 = a, and T(a) is a S x S-matrix such that 

(r(a) + -,r(a)++) = (o-+,o ++ ), 

(r(a)~,r(a)- + ) = -k-7r(A v + D'(0)) 



a 



■{al~ 



k-TT-)(k-TT~ -K^y 1 



x{I—,L- + )(C + D). 
In particular, using the notation r/°) = E(Y(1)) < 0, for i 6 5, 



(5.10) 



lim e ax P(r+ <oo\M{0)=i) 



V 



(a) 



-(/* (a) )~k-. 



Proof. We first compute the denominator of (5.3). From (5.4), it is 
easy to see that 

„(«) 4#(0) h( Q ) = /*(«) (Z> m (a) + A v )h» , 

since (C + D(a) + aA v )h( a ) = 0. Thus the denominator is r/ Q ', which is 
clearly finite. This also implies condition (5.d). We next compute v^ a ' Jq°° e au G(u) du. 
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Then, (5.6) and (5.7) yield 

(0-,(u^) + ) e au G{u)du 
Jo 

= -(0", (n {a) ) + )(C + D(a) + aA v - (C + £>)). 
a 

Similarly, (5.6) and (5.8) yield 

((i/ (a) )^,0 + ) / e au G{u)du 
Jo 

= -((/x (Q) )", + )(C7 + L»(a) + aA v - (C + £>)) 
a 

- (//<*> )-k-7r- (J— , L-+) (A v + D'(0)) 

_i( M («))-( a /- -k-7T-)(k-7T~-K ( ^)~ 1 (/— ,L- + )(C + D). 

a 

Thus, (5.3) yields (5.9) since tt - (/—,£-+) = vr and ^ a \C + D(a) + aA v ) = 
0. Finally, summing up (5.9) over all j G S yields (5.10), since (C + D)e = 
and 

7r(A v + L> (1) (0))e = £(Y(l)). □ 

Remark 5.2. When S + = and v = — 1, the results in Theorem 5.1 are 
fully compatible with those obtained in Theorem 3.1 of Miyazawa (2002). 

It may be interesting to consider asymptotics of the probability that Y(t) 
overshoots level x continuously. To this end, we define B of (5.2) as 

(5.11) B{x) = A' 1 (-^ + ) A^e-^^)- 1 . 

Then, using (5.6), we have 

u (a) r e ax B ( x ) dx = ^(a) f ~L ++ + \ A + +> 

Hence, we obtain the following result, which extends Corollary 4.9 of 
Asmussen (1994). 

Theorem 5.2. Under the same conditions as in Theorem 5.1, fori € 5 
and j G S + , 



Inn e ax P(M(r+) =j,Y{r+) = x\M(0) = i) 

(5.12) 

7 H 



h^ 



77O) 



» {a) r ++ 1 a; 
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6. Applications. We briefly discuss applications of our results to a risk 
process and a fluid queue with extra jump inputs. Define a process Z x {t) for 
each x > as 

Z x {t) = x-Y{t), t>0. 

Then, Z x (t) is a risk reserve process starting with reserve level x, and —v(i) 
is the premium rate under background state i £ S, while a claim whose 
size has distribution Fjj arrives when the background state changes from 
i to j with rate Dij. For the risk process Z x (t), a primary interest is the 
ruin probabilities and their asymptotics. The latter are obtained by Theo- 
rems 5.1 and 5.2. Numerical values of the ruin probabilities may be obtained 
taking Fourier transform of (4.1), using Theorem 4.1 and Corollary 4.1, and 
applying numerical inversion technique. 

We next consider a fluid queue. Suppose that Y(t) describes the net flow 
of a fluid queue with extra jump inputs. Then, the buffer content V{t) at 
time t is given by 

V{t) = sup (Y(t)-Y(u)), 

0<u<t 

if V(0) = 0. As is well known, under the stability condition (5.1), which is 
assumed from now on, V(t) and M(t) converge jointly in distribution as 
t — > oo. Denote a pair of random variables having this joint distribution by 
(V,M). Then, the well-known formulation of Loynes (1962) yields 

(6.1) P(V >x,M = i) = TTiPf supy(n) > x\M(0) = i) . 

\u>0 J 

Hence, this stationary probability is the hitting probability at level x of the 
additive process Y(t). Thus, converting (5.10) to the dual process, Theo- 
rem 5.1 yields the following: 

Theorem 6.1. Under the conditions of Theorem 5.1, let a be the same 
one in the theorem, Q(' be the minimal rate matrix satisfying the following 
matrix equation for a substochastic matrix IV : 

(6.2) - ^ + l^Q^ = A^I^(C(du)+D(du))^ + iy u Q { -\ 

and let (3~ be the stationary probability vector of Q^~> . Then, we have, for 
ieS, 

_ (o) ( Q ) 

(6.3) lim e ax P(V>x,M = i)= V . Q j3~(h^)~. 
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APPENDIX 

A.l. Proof of Lemma 5.2. We first consider the case that i £ S + . From 
(4.4), we have 

Aij{e) = Sij + C (i) - v(i)d (Cii + bij{e) + 9[Av]ij) - 

Thus, we get (5.4). For i 6 S~ , we first compute the moment generating 
function of the first term of (4.4). 



-1 



v(i) 



OO /"GO . , 

e ex dx f eCw-*)^" 5 



(I—,L- + )D(dy) 



v(i) 



(9I—-K^y 1 (e 



yOI- 



# K{ - ) ){r~,L-+)D{dy) 



Hence, using the following equation that is obtained from (3.11), 

-/ <? Ki -\l— ,L-+)D(dy) 

Jo 

= (I—,L- + )C + (K^-9I—)(I—,L- + )A V + 6(I—,L- + )A^ 



we have 
-1 



v(i) 



OO P OO 

e ex dx I e iy - x)K( ~\l— 1 L- + )D(dy) 



5 ij + —[(0-,L-+)(-A v ) + (9r 



J ij 



(I—,L- 



x(C + 9A v + D(6))] tr 

We next compute the moment generating function of the second term of 
(4.4). Similarly to the case that i € S + , we have 

Mk)Mk) : 



v(i 






v(i) 



[(0~ , L-+) A V (I + A"i flv (C + D{9) + 9A v ))] l7 . 



A.2. Derivation of (5.8). Similarly to (5.7), (4.6) yields 
e ax G ij (x)dx 



(A.4) 



-1 



v(i) 



OO POO POO ,_. 



e ax dx / dw I 

Jx 



(I—,L~ + )D(dy) 



+ -(0— ,L-+)A v A-i QV (C + £>(«) + aA v - (C + £>)) 
a 
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We compute the integral in the bracket of (A. 4) in the following way. Using 
the fact that K^-> — al and k~7r~ — K^' are nonsingular, where the 
latter is obtained by Corollary 3.1, we have 

OO POO />0O 



e ax dx dw e (y ~ w)K( \l— ,L~ + )D(dy) 

J X J W 

/■OO f"W /'OO ,_, 

= / dw e ax dx e (v- w ) K{ -\l—,L- + )D(dy) 

JO JO Jw 

1 /* OO P OO 

= - / dw (e aw - l) e (y- w 1 K( ~ } (I— , L- + )D{dy) 
a Jo J w 

= !(#(-) - al—y l ( r 'e yKl ~\l— ,L~ + )D(dy) 
a \Jo 

-(I—,L- + )D(afj 

1 f°° <—\ 

- -(k~ir- - K^y 1 / (ykTir- - (e yK( ' - /"")) 
a Jo 

x(I—,L-+)D(dy). 

Using the relation (3.11), the first integral in the above equation is computed 
as 

(a/— - K^)(I—,L- + )A V - (I—,L- + )(C + D{a) + aA v ), 

while the second integral is computed as 

{I—,L-+){C + D)- (k"ir- - #(-))(/— , L-+)A V 

+ k-7r-(/— ,L- + )(A„ + J™vD(dv)y 

Hence, using the fact that k~ = (k~7r~ — lf( _ )) _1 k~, we have 

/* OO /* OO /* OO 

/ e a:r dx/ dw / ^-^"'(J— ,L- + )D(dy) 

Jo Jx Jw 

= - ((al— - K^y\l—,L-+)(C + .0(a) + aA v ) 
a \ 

-k-7v-(I—,L- + )^A v + J^yD(dy^j 

- (k"ir- - K(-))- 1 (/--,L- + )(C + £>)) . 

Substituting this formula into (A. 4), we get (5.8). 
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